|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
5
|
Posted - 2011.09.06 18:16:00 -
[1] - Quote
EVE Marketeer is a website in the spirit of EVE Central and EVE Marketdata, just better than both (if I may say so myself).
It gathers data from both of the services above, and combines this with the data that is coming from our own uploader, guaranteeing the most up to data data you can get anywhere. We also do some special magic to try and make sure idiotic orders are filtered, but we're not always successful.
An API is provided for developers in three different formats: XML, CSV and JSON. Most of the data can be retrieved by way of the 6 simple calls we provide.
In addition to providing market information, EVE Marketeer is filled with some very handy tools to help you earn money, and keep track of your money, these include:
- Manufacturing cost calculator
- Mining profits
- Trade Finder
- Shopping List
- Best items to trade between regions
- Order Tracking (do you have the highest/lowest sell/buy order)
- Asset Search
- Transaction list / profits view
- Awesome forum signature images based on character data
This is only the beginning. We aim to provide you with all sorts of information. Please let me know if you need anything, and I'll see if I can implement it. There is a very useful feedback form on the website that keeps track of all requests that have been made, and how much they are loved/needed. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
5
|
Posted - 2011.09.08 17:46:00 -
[2] - Quote
With the fixes/additions to the API, I hope that the your orders information is being updated correctly again (though I imagine it might still go wrong if your orders last more than 7 days). I'll fix that this weekend.
Due to RL time constrains since working fulltime (I think you can guess around what time that happened), I'll probably only be able to work on EM during the weekends, though I'll of course respond to posts here all the time. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
5
|
Posted - 2011.09.10 16:32:00 -
[3] - Quote
Today, I made some modifications to how the item information page is loaded. It now loads all tabs dynamically to save on overal page loading time.
Overall I'm currently working on some optimization, since I've noticed the website become increasingly slower with an increasing amount of data.
In addition, I might be looking for people whom are interested in helping develop EVE Marketeer. I'm not certain yet, but since I noticed my own availability for actual work dropping, I am open to any interest people might have.
EDIT: Also hard at work on converting the website to the new API key system :) [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
5
|
Posted - 2011.09.10 19:04:00 -
[4] - Quote
It was a known problem. I had some issued upgrading MySQL. For some reason it determined that it shouldn't start anymore, and for just as obscure a reason, it suddenly works again. It should be stable now (if a bit slow).
UPDATE: Okey, **** me, it is NOT stable. I'll be working on fixing that. Until I say it's fixed, please don't worry if you have intermittent (or constant ) connection issues. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
5
|
Posted - 2011.09.11 07:42:00 -
[5] - Quote
I would be mostly looking at people whom can develop stuff. In the end, I'm aiming to make EVE Marketeer the best, but that will probably happen faster with some more people to share the load with.
Are you familiar with mercurial repositories? And do you have any ideas of what you would/could built into EVE Marketeer, or what it should be in the long term?
Different note, it has been in EMK for some time already, but I"ve never really come around to building an interface element for it. It is a view to allow you to look at the price levels of PI components and determine whether it's really worth it to develop it to that level 4 item. http://www.evemarketeer.com/item/piprice/Enriched_Uranium
You'll have to enter the item names manually (substitute underscores for spaces). I'll eventually add this in a tab under the item screen.
Oh, and the database should be functional again now. It took a rather long while and some rebuilding, but everything is as before :) [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
7
|
Posted - 2011.09.15 19:00:00 -
[6] - Quote
Ok :) I'm using mercurial for the EM versioning so you'd have to use it. Not that my versioning is exceptionally decent (in fact, it's horrible, but at least it's versioning), but it allows for easy updating of the website (and using it for that is bad practice too, but it's a hobby project, so it's allowed). I'll see whether I can create a general account for EM developers on my hosted repository, otherwise I might migrate it to the server itself.
In any case, it must've been something I was doing to the server, it never let me down like that before... it does seem to have killed all the tables though. That'll be repairing myisam tables for the rest of the night. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
7
|
Posted - 2011.09.17 23:17:00 -
[7] - Quote
This needs to be on top!
And I've got a good excuse, I added the utilization of customizable keys. Now you guys all need to enter your information again, but it's worth it. Everything is done automatically. Mainly thanks to Dragonaire and Yapeal though :) [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
7
|
Posted - 2011.09.20 21:17:00 -
[8] - Quote
Ah, guys/gals, I think I've come up with a really nice feature now (or well, it existed elsewhere of course, but now I bring it to the masses).
It's called 'My Blueprints', and it simply shows you a list of all blueprints you have, with their material levels (as based on the industry jobs you've started/completed) and based on the prices in your current region, whether it is worth it to build them. Nice red and green row backgrounds show you what is worthwhile at a glance.
I'm going to be using this one often :)
Also, the order uploads have finally caught up to reality, so all market prices should be current again now. I also made the checking of false or idiotic orders MUCH more robust, taking into account such things as the most common prices, excluding outrageous orders, while retaining a margin of flexibility which should allow for prices to change (and be played with quite a bit). In the future this may be refined to not simply throw the odd orders away, but flag them and hide them until someone wants to see them (and even search for them specifically, who knows what nice stuff might be there, it's also excluding honest mistakes now ).
Oh, and last but not least, the site now remembers what region you had selected last time you were there, so no more automatically switching back to Jita! [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
8
|
Posted - 2011.09.21 05:48:00 -
[9] - Quote
Me knows, it is horrible. Fix under way. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
8
|
Posted - 2011.09.21 16:08:00 -
[10] - Quote
Should be fixed now. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
9
|
Posted - 2011.09.22 06:46:00 -
[11] - Quote
Where exactly do you get these errors? The whole site runs on the same database, and the site seems to be running fine.
Update: My guess is you're using an outdated version of the uploader or an API reference to the old site. Try using www.evemarketeer.com instead of evemarketeer.com. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
11
|
Posted - 2011.09.24 13:08:00 -
[12] - Quote
BIG update today!
I added pretty much everything that you could do to yourself for corporations. That means you can now view assets, orders, transactions and blueprints (profitability) for your corporation.
This information is ATM only accessible when you are the corporation director.
Of course, to make it all work, you need to have added a corporation key to your account. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
11
|
Posted - 2011.09.25 08:12:00 -
[13] - Quote
I'm on it!
UPDATE: Fixed it has been [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
11
|
Posted - 2011.09.25 22:12:00 -
[14] - Quote
Shingyoku wrote:Well this is kind of embarrassing, I usually use keepass for my passwords and it seems to have not saved my password when I setup my account. I also noticed there's no password reset on the site, any plans to implement that?
Ah, yes, this is originally an improvement on a corporation website I made, and if anyone lost their password there I could simply reset it myself. I'll send you a new password soon, and make a way to easily reset it yourself (which is going to be interesting, as I do not save any email adresses by default). [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
12
|
Posted - 2011.09.26 16:52:00 -
[15] - Quote
Gretzaki wrote:Site is down again, it's hard to use the data that is being collected when you can't access it :(
I am very sorry about this. I assure you, I am not doing it on purpose and am trying to track down what is going wrong. Previously, I knew it had something to do with an unlimited number of threads spawning, but now it just seems to decided to die every 1.5 days.
I can't always be online however, so it may take some time to restart if it isn't working (actually, the remote reboot doesn't work either. It just totally loses connection. Only a complete re-initialization of the VM brings it back online).
And... The logs show nothing! :S sorry, but it may take a while, or it may be fixed tomorrow, that's all I can really say about it [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
13
|
Posted - 2011.09.27 16:52:00 -
[16] - Quote
Shingyoku wrote:Domi Etymology wrote:Just send them an ingame eve-mail. No emails required :P I really like this idea. Use the trust feature in the browser or something.
I would love to, but sending Ingame mail cannot be automated, so if you are okey with waiting for me to send a mail, thats fine :P [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
13
|
Posted - 2011.09.28 09:46:00 -
[17] - Quote
Turhan Bey wrote:I strongly recommend against using IGB trust to disseminate lost passwords. It is one of the easier things to spoof. Registering an email address on account creation would be the ideal "easy" solution.
EDIT: However, sending in-game EVEmails for password reminder/reset could be secure if the account has a CAK registered with character info access. But as stated above, it cannot be automated. I am not planning on using the IGB for any authentication whatsoever :)
It might just be safer and best to do those few times it happens manually. Until CCP builds in automatic sending of IG mails (spam ftw?). [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
13
|
Posted - 2011.09.29 18:15:00 -
[18] - Quote
Hey, thank you for your replies and help trying to get it fixed.
I made a post a few hours ago, but it seems it didn't get trough. First of all, I've installed logging software, that at least gives me an idea of what happens. If you feel interested, you can view the server stats via Munin
As you can see, there isn't anything shocking there, nothing suddenly happens, except a sudden spike in the usage of one disk. I've yet to find out what is causing this.
To clear two things up. It is not the error you've been seeing about logging, at least it seems very unlikely. That is just due to me neglecting to recover that table after the last crash (it's pretty much always writing to the log table, so every crash kills it :P).
It does not seem to be the database either, as I've been monitoring that, and it steadily keeps at about 5-10 connections doing queries a second, which isn't enough to kill it.
[img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
14
|
Posted - 2011.09.30 20:13:00 -
[19] - Quote
Ok, I basically removed every server package that had anything to do with serving up pages and reinstalled the latest versions, and sometimes even different packages (I'm now using nginx instead of apache, and running php as cgi instead of module). In any case, I hope it solves some of the problems.
Also, I might need to start processing EMD orders in the same way I now process EMK orders, since that seems to be the fastest way, and I now get an immense backlog of EMD orders :P or I could just work on making order processing faster.
Gretzaki, expect an ingame mail about helping development soon. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
14
|
Posted - 2011.10.01 07:30:00 -
[20] - Quote
It actually does directly send them to EMD, even before it sends them to EMK. So in that regard everything plods along pretty well even if the website is down (though the tool will keep complaining about not being able to upload to EMK, it should have uploaded to EMD fine) :P
I'll take a look at the scanner page, maybe something to do with the move. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
14
|
Posted - 2011.10.04 18:32:00 -
[21] - Quote
Scrapyard Bob wrote:The scanner page is definitely still having issues, if it does come up, it eventually ends up with a gateway timeout error - which means my noble attempt to leave an alt logged in overnight comes to naught. On the feature request side: http://www.evemarketeer.com/statistics/uploads- It would be better if this page was sorted by region name in alphabetical order, instead of by RegionID http://www.evemarketeer.com/statistics/regions- same request, please sort by region name http://www.evemarketeer.com/item/itemprice/Oxygen_Isotopes- On the regional prices tab, it would be useful if there was an indicator as to how current the data is for each region. Maybe presented as "The Forge (3 hrs)" or "Domain (2 days)" - The orders tab, doesn't let me look at other regions
Thank you for your feedback.
Sorting on the regions page makes sense, I'll fix that.
Sorting on the uploads page is already by name, only from left to right and up to down, instead of up to down left to right.
The itemprice page currently has a field that shows you how recent the data was. I agree it might be useful to add it to the regional tab. I do wonder what you mean by, the orders tab does not let me look at other regions though. I think your issue is mainly with having to reload the entire page to switch regions, while it could be done faster? Or that you would like to quickly look at a different region without changing your default?
In regards to the uploader, it does not upload to EVE Central. Nor do I have plans to support it in the future. I do understand Muscaat of EVE Markets made an uploader that uploaded to all of our websites (EC, EMK and EMD), though the one that I can download from his website at this moment does not work (at least on my PC).
Lastly, the uploader page, I have no idea why it would be giving gateway timeout errors. I'll test it myself and see what I can dig up. It it not really acceptable that people leave their computers on all night to upload, only to find that it crashes halfway trough. Otherwise I'll just make the refresh AJAX too, and have it automagically refresh it's list if it detects no activity. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
17
|
Posted - 2011.10.13 22:06:00 -
[22] - Quote
Did some minor fixes, and implemented caching today (for home and for statistics pages). Caching might be a bit erratic at the moment. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
22
|
Posted - 2011.10.19 18:35:00 -
[23] - Quote
Thank you for your kindness I'm still feeling unwell though.
Which is one of the reasons I'm uploading the entire EVE Marketeer codebase to Github. Previously, I already added a few people to the mercurial repository I was using before, but this seems immensely easier. Besides, everyone will be able to contribute instead of just a few.
I'll also expose access to the live database to a few people that I trust not to give away private information.
This will hopefully allow updates to happen even if I'm not feeling ok .
The only thing I'm struggling with is providing a copy of the database. I could allow a complete download, but at the moment it's about 45 GB, which is probably a tad much for most people. Anyone have any ideas? [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
22
|
Posted - 2011.10.19 21:24:00 -
[24] - Quote
Hmm, git is being recalcitrant as usual. I wonder why I still try... Maybe just stay with mercurial... [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
22
|
Posted - 2011.10.19 21:51:00 -
[25] - Quote
Woot! EVE Marketeer was on github. And then I noticed I had some production passwords in the source that should have been hidden. Oh well, I'll give up for today. Tomorrow will probably see me simply committing the damn thing to bitbucket. I do (again) not feel like dealing with git ever again.
And yes, both of those websites allow people to commit patches which I can then merge into the main codebase. That's kind of the point
You won't be able to edit the code on the site itself though, but using mercurial should be relatively painless (as opposed to git).
EDIT: Regarding my sig, yeah, but I seem to not be able to edit it anymore. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
23
|
Posted - 2011.10.20 06:41:00 -
[26] - Quote
Try appending ?debug=3 to any URL if you want to see loadtime and queries.
The specs are: i3 Intel processor 4 Gb RAM 2 1 Gb SATA disks in raid 1 100 Mbit uplink
Those are probably the most relevant ;) [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
24
|
Posted - 2011.10.20 16:29:00 -
[27] - Quote
I know you were :) this is just the best it can do at the moment. Havent found a decent way to incorporate the stats into the page yet. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
24
|
Posted - 2011.10.20 17:28:00 -
[28] - Quote
Lol, nice going there
Don't you think it's a lot of space (distraction) for just the stats though? That has been what has kept me from implementing it this way. I would do it if I had something else to show in that bar, but right now, it's just a waste of space (though I doubt many people would mind, spending 10% of the (visible) page height on stats feels wrong to me)
That said, think up something useful to go on the left side of that box, and it would be ok ;) maybe we should also show number of users active or something [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
24
|
Posted - 2011.10.20 18:08:00 -
[29] - Quote
Scrapyard Bob wrote:I see no issue with it being in the bottom bar, or in tiny text at the bottom of the screen (I'd prefer it down there, out of the way rather then in a left/right column which would shrink screen width).
Ah, yes, I hoped it was clear I was referring to the left side of the bar, not left side of the page ;)
I'd been thinking about tiny text at the bottom myself, but there does not seem to be a color that will work for both the light and dark parts of the background ;) I might just implement something along Controller's design. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
24
|
Posted - 2011.10.20 19:04:00 -
[30] - Quote
Ok, so I finally got a decent version of the EVE Marketeer source uploaded. As I suspected, using Mercurial was immensely easier than Git (I'm not bashing Git, I'm just saying I'm not cut out for it, version control should just stay out of your way).
https://bitbucket.org/aeolun/eve-marketeer/overview
The database can also be downloaded (only the structure for now, populate it with data yourself :P) from here.
Now go ahead and let me know about those glaring SQL injection attacks, cross site scripting and the fact that the comment form secretly allows you to enter whatever HTML you want [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
25
|
Posted - 2011.10.20 20:52:00 -
[31] - Quote
I had to get used to it for a bit, but I think it looks pretty nice. You did a clone of the code? If so, can you submit it? Will have to figure out how bitbucket handles that one way or another. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
27
|
Posted - 2011.10.22 14:53:00 -
[32] - Quote
Ah lol, I didn't see your extra messages because they were edits to the previous post.
The text doesn't actually look better for me. Quite the contrary, it's got a fuzzy haze over it now (antialiasing gone wrong).
Ah, the difference between mercurial and SVN (I believe you used that previously) is that after you commit it to your local repository, you also have to push your changes to the server. I do not believe you can do this at the moment because you do not have write permissions on the repository.
To push it, I believe you have to follow steps 2, 4 and 5 on this page: http://confluence.atlassian.com/display/BITBUCKET/Sharing+Code+in+Bitbucket
Of course, I'll probably be implementing the zipped up file before that happens :P [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
28
|
Posted - 2011.10.23 08:56:00 -
[33] - Quote
By default, I'm using the production efficiency level of the character selected at that moment. If none is selected, a PE of 0 is assumed. The PE level is at 0 by default too, but you can chance that one with the inputs above the information itself.
I have not considered it for a second, as son as I saw it I knew it should be in EVE Marketeer, but the recent troubles have given me other things to do. There are just way too many things that should still be added ;) be assured it will eventually make it's way into EMK though :)
Besides that, I also picked up on your wish to have a multi-region/market hub price, which I agree would make a good estimate of value, so I'll be adding that too once the problems are gone. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
29
|
Posted - 2011.10.30 19:28:00 -
[34] - Quote
EVE Marketeer is back up!
For those of you whom did not notice yet
We're currently working on getting the backlog of order uploads processed as fast as possible, and making good progress. Some issues were detected with the new process control system, but I'm pretty sure I'll be able to fix those as time goes along.
Now on to adding some new features!
In addition, my apologies for the sadly extended downtime. Hopefully the new system will scale better. If not, I'll have to look at increasing the server capacity. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
31
|
Posted - 2011.11.01 16:58:00 -
[35] - Quote
That is because the backlog isnt finished updating yet (going from oldest till newest). The uploads in the last hour are actually sort of a misnomer in that it shows the amount of uploads processed that contain data in the last hour.
That said, there IS a problem where the backlog is not being updated, but a very minor one that will be fixed this evening :) [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
31
|
Posted - 2011.11.02 18:05:00 -
[36] - Quote
Seen it, confirmed it, and fixed it now. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
31
|
Posted - 2011.11.03 21:02:00 -
[37] - Quote
In addiiton, the website should now stay up. My idea of using PHP for threads was useful, but PHP doesn't do garbage collection, so the server kept running out of memory after half a day. I'll be monitoring the situation now. I hope it stays steady. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
31
|
Posted - 2011.11.04 17:47:00 -
[38] - Quote
Ok, true, PHP does garbage collection, but as far as documentation goes, that comment by the user was it... I do not mind using beta features, but even I have a limit on how far it can go.
Secondary reason was I got sick of having to restart all threads by hand at every update, so now they just restart themselves ;) the script dies, the memory is cleared, and the new script takes over. The only problem being the server still magically killing my processes... [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
31
|
Posted - 2011.11.06 11:13:00 -
[39] - Quote
Please all look forward to uploading to EVE Central with the EVE Marketeer uploader soon :) I expect it to be done this afternoon. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
32
|
Posted - 2011.11.06 21:24:00 -
[40] - Quote
Actually, it wasn't reset. The user summary page is just deprecated and uses the wrong table to calculate the statistics.
UPDATE: Which is also the reason why it was removed in this update. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
32
|
Posted - 2011.11.06 21:53:00 -
[41] - Quote
I will bring the information back, just not on that page. Will probably be integrated into either the UI, the Account page or another page.
The upload key can be retrieved from the upload page as well, which should be a pretty logical location. (UPDATE: though it might be a bit more prominent, it's very overshadowed by that large block of text underneath it) [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
32
|
Posted - 2011.11.06 22:17:00 -
[42] - Quote
I cannot replicate the problem with the my orders page. Are you using a character without orders?
I moved the information that was available at the account page to... the account page :) you should be able to view it there now. And I updated the description on the homepage.
EDIT: Well, you'll have to wait for the uploader update. I'm not going to put it on the website without testing it with EVE Central as that was the whole purpose of the update. Sorry :P [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
32
|
Posted - 2011.11.07 20:01:00 -
[43] - Quote
Controller Vrelk wrote:Yes, my API had transactions and orders. It shows them on the API page on the marketeer site. I have used this API with these settings since I signed up, so it has had time. The orders page just doesn't show any orders, the transaction page says I need to log in or add a character. This is the API access mask: 29364610
You were correct. Though I was too. It seems you had only enabled a select few items (which I agree is the point of customizable keys), but the website clearly stated that it could exhibit strange behaviour if a full key was not supplied.
And strangely behaving it does
Problem is, you need to add at least the CharacterInfo parameter, or the website will not even find your characters. This is obviously quite troublesome for the whole process of seeing whose orders you are currently looking at, and that is why the orders page didn't show anything.
I've now added a clearer warning to the website that will notify you if you haven't selected CharacterInfo, this should show up for you as well. Add that one to your key, and you'll probably be able to use EVE Marketeer within half an hour or so (as soon as the character list updates). [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
32
|
Posted - 2011.11.07 20:54:00 -
[44] - Quote
Damn, that's odd. I'll at it again. This screenshot helps! [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
32
|
Posted - 2011.11.07 21:09:00 -
[45] - Quote
Ok, it probably has to do with CharacterSheet being disabled then (damn CCP for naming them so close together).
It's now also mentioned on the key page. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
33
|
Posted - 2011.11.08 07:41:00 -
[46] - Quote
Ok, just to let you know, when it works a character selection dropdown will show up on the left side of the secondary menubar. As long as it doesn't something is wrong, though I honestly couldn't say what is causing this problem now. I'll get to the bottom of this yet! [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
33
|
Posted - 2011.11.11 19:17:00 -
[47] - Quote
Umm, turning on EVE Central proccessing 1 day ago while I couldn't keep an eye on it turned out to be the wrong decision, so the queue is now more or less filled with lots of real and bogus updates from eve central. Problem is I don't know which are real so I have to let the entire queue finish. Or purge it which would remove all real updates as well. Will soon implement something to delete only queued items from a certain source.
I appreciate the uploader bug reports btw, I'll see if i can fix the problem this weekend (I'm a bit distracted by Skyrim, but this should be possible :) [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
33
|
Posted - 2011.11.12 19:07:00 -
[48] - Quote
Abdiel Kavash wrote:I am getting the above message too. I downgraded to 2.5.4EM, which seems to upload fine (the uploads are showing in both the uploader and on the website under My Market > Upload History. However, the website and the API still show an old value (as in, 3 days old). Is this a bug, or is there some delay in processing uploads?
The bug should be fixed in uploader version 2.6.1 which I've just released.
Furthermore, the site should be processing orders as normal again too though it might still take some time for it to catch up the backlog. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
33
|
Posted - 2011.11.14 22:44:00 -
[49] - Quote
Shingihada Rubik wrote:Huh, I thought I posted something here earlier today, but I guess not. Anyways, the new update fixed everything for me at least. So it's working flawlessly for me right now, however, when I booted up my computer this morning (Windows 7) I got a new error message, but just restarting the app worked. I'm just posting to let you know since the app still works fine. Also, I constantly get the error about not being allowed to post HTML, so I just pasted the error to Pastebin: http://pastebin.com/S76D7eCU
Ah, yes, I've seen this too, but I cannot understand why it fails intermittently, it shouldn't be different on each startup. In addition, I only see it when running from the IDE, so I've yet to find out what's causing it.
@Scrapyard Bob: Does it stop looking up items (say, the market window does not constantly pop up anymore), or does it stop sending data? Since after a few hours, the entire market would be scanned, and EVE doesn't generate new cachefiles if everything is cached already (even if the uploader deleted the files).
If the second is true, was it always doing this? Or is it a new problem?
@Endeavour: I do not get any errors, where exactly are the problems occuring?
I've also been notified that the server has bad harddisks, which means they have to be replaced. In any case, the server would be moved soon anyway (probably this weekend), but you shouldn't notice anything this time (I've been careful about setting my TTL this time), and the true time I move will mostly will depend on how soon I finish or get bored of Skyrim [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
34
|
Posted - 2011.11.15 17:42:00 -
[50] - Quote
Lots of things to reply to :P
Yes, the delete cache option is deleted by default, because a big cache makes EVE slow and the uploader as well (since it has to check every file in the dir). If you let one of the programs delete the files eventually you should be fine though.
@Domi: That is evemarketeer telling you it doesn't want the data anymore I believe, but it might be the uploader. This might be happening because one of the sites is down, which would cause uploads to hang before a timeout occurs. Will look into fixing that (negating services that are down, or lowering timeout).
Endeavour, how do you go to the item? The URL has changed. The search function should work fin and I thought the browser should also work.
@Scrapyard: That is bad. I know it happened to me sometimes, and the only way to fix it is to reatart the IGB. Maybe it has to do with timeout. I might make timeout selectable, so you can put it more than 3 seconds. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
34
|
Posted - 2011.11.15 23:34:00 -
[51] - Quote
Well, it should remember your settings :P at startup the uploader tells you where your setting file is. If it isn't writing it correctly, maybe you can change it manually. If the problem persists, I'll try and see what I can do about it. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
34
|
Posted - 2011.11.15 23:56:00 -
[52] - Quote
It could be writing an empty config file on crash, which would explain why the next startup reverts to default. I'll have to check that. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
34
|
Posted - 2011.11.16 14:27:00 -
[53] - Quote
C:\Users\*username*\AppData\Roaming\eve_marketdata\config.ini
Now that I think of it, the EVE Marketdata uploader might also be overwriting your perfect config if you are running it at the same time (or intermittently), I had that after I first started building the uploader.
I could of course just make a unique config file, but at first this was useful to make the switch easier for people. I'll consider changing the location of the configuration file at the same time as adding variable URL uploading to it. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
35
|
Posted - 2011.11.20 09:54:00 -
[54] - Quote
Huh? I replied to this yesterday...
In any case, will be fixed (the outdated information). And will be taken into consideration (the API queries), ideally you just wouldn't call the API with invalid information [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
35
|
Posted - 2011.11.20 14:16:00 -
[55] - Quote
Ok, well, since you ARE our best uploader, I think I might just make it accept invalid numbers as zero rows. Will see what I can do [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
35
|
Posted - 2011.11.22 20:48:00 -
[56] - Quote
It is monstrous what sort of an effect a specific server can have on your application. EVE marketeer is now running on hardware 4 times worse than the previous setup, but it's processing way faster than ever before... This could be awesome :D
First impressions of Storm on Demand are very good. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
35
|
Posted - 2011.11.27 00:27:00 -
[57] - Quote
@Scrapyard: You are correct. The uploader is indeed very unresponsive while uploading. I'd been thinking about that problem myself, but have obviously not found a fix for it yet. Having the uploads handled in different threads would be nice (and very effective, at least in terms of UI responsiveness), but I so far have been unable to implement it.
@Turhan Bey: Thank you. Besided the old data issue, which I'm trying to fix in the station_info API (and then link jita_info to that), it now seems to be giving a template error (which is weird, as those functions should not look at templates anyway).
[img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
35
|
Posted - 2011.11.27 11:34:00 -
[58] - Quote
Ok, I think I fixed station information now (and thereby the jita_info API too). I also fixed a bug in the 'my orders' page which caused it to not be able to scan your orders. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
36
|
Posted - 2011.11.30 07:52:00 -
[59] - Quote
Lol, ok, pagination here I come. It seems the total history for one item finally exceeds the limits of php.
And yes, I'll look into the mission page, it seems it should react to the time limit, but I'm not sure about it. Today is the first time in a while I finally have some time to actually do something again, so I hope to do some cool stuff today. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
37
|
Posted - 2011.12.01 21:28:00 -
[60] - Quote
Most of those things fixed. And put the server in temporary reinforced mode while I mess with the database. [img]http://www.evemarketeer.com/player/sig/511049420[/img] Want images? |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.04 16:37:00 -
[61] - Quote
Ok, so today I built a few of the features that have been on the wishlist for a while.
In addition, I also updated the database to use the new Crucible database.
The new things are: - Show a aggregate of the stats for the top 5 regions. This means the website takes an average of the values (for example lowest sale price) in the 5 regions with the most orders. This should help counter any market manipulation attempts a bit. An API for this feature is coming soon. - Allow filtering by station in the orders list, as well as clean the list up a bit by hiding most of the orders you might not want to see. - Add an addition row to item information that shows the changes in price the past day, and also shows an estimate of the buy/sell ratio that is used in some computation on the website - Importing from EVE Central and EVE Marketdata have been enabled again and do not seem to be giving any problems, except that those two websites are not sending a lot of data (not any data atm, which I cannot understand).
You might've noticed I've been working hard on fixing stuff that was on the website for a while. This is because I felt that the overal quality of some things on the website was a bit low. New features have been moved to the background a bit, but are certainly not forgotten. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.04 18:46:00 -
[62] - Quote
Ah, awesome, this is the new datadump at work.
It is fixed, and the other problem is fixed as well. I do not show specific rat bounties anymore. This data was not in the SDD anyway, and scraping them from the EVE cache with every database update is going to be obnoxious, and even then it will be inaccurate. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.04 19:33:00 -
[63] - Quote
Well, the rat bounties were off even when I implemented it, that's why I put the +/- behind the value. It might be that the totals of rat bounties are off too, but I think those are generally correct (unless the API gave me errors).
And I added another feature. You are now able to total your buy and sell orders in the transaction history screen, making for some interesting view of how much you earned on a specific kind of item. It seems PLEXes are one of my major sources of income. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.06 22:40:00 -
[64] - Quote
Both seem fine to me. Are you still experiencing the issue? I really cannot imagine this happening. The row would have to be deleted from my summary table, and I never actually delete stuff from there unless it's replaced right away.
I'll see if there is any reason this could be happening.
As for the calculation. No, it simply takes the regions that have the most orders, though I imagine it would be a good idea to take the top 5 regions that with the most orders that are not out of date. I'll add that to the calculation.
In regards to bounties. If you put it like that, I'm a whole lot more inclined to think something is wrong with the way I retrieve data from my tables, which could cause a problem. I'll still have to export the bounty prices again though (which I will be doing eventually, but for now I'll first look into the correctness of the totals).
The uploader is a bit of problem right now, as my computer has crashed making me lose the source code of the uploader... which means I'll have to rebuild it. Which is good in the sense that it will probably be without errors, but bad in the sense that it's going to take some time. If you were experiencing no issues with a previous version of the uploader and have disabled EVE Central uploading anyway, you could consider downgrading to a previous version. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.06 23:58:00 -
[65] - Quote
I am actually using jungledisk and it is making me very happy. It was the reason I couldn't care less that my harddisks suddenly stopped (that, and all my projects being securely in an offsite version control system, which is a backup by default).
The problem was that it didn't backup my downloads folder (which for the sanity of the backup solution, is a good thing) and the uploader source was in that one folder for some reason, so it's vaporized. But don't worry, as long as EVE Marketdata still has their source I can at least start off a decent basis.
Oh, and I also use dropbox, just not for backups ;) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.07 09:06:00 -
[66] - Quote
Actually, the minimum for the market call is 3 seconds, which is why it's at that value by default :P you could make it slower, but you can't make it any faster (unless CCP has changed something without my notice).
The new uploader should follow an alltogether different format of entering that data. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.08 22:21:00 -
[67] - Quote
Maeste, I've just send you an EVE Mail, registration should be working again. It was indeed broken for a few days, but people were very fast to point it out :)
The only reason for the values to come from the future is indeed if your system clock is by some reason ahead of the EVE clock. This has been built in mostly to prevent people from sending illegal data that will always be seen as the most recent. I might relax the requirement a bit so as not to fall over a few seconds difference :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.09 23:22:00 -
[68] - Quote
A lot of order filtering is applied. It drops all outrageous orders. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.10 20:48:00 -
[69] - Quote
Rest assured :P the new uploader won't do any such thing ;) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.11 09:24:00 -
[70] - Quote
Well, atm I only check whether a message comes from the future. I do not really mind getting messages from anywhere in the past. That is mostly due to the fact that uploads might end up in a queue and be recieved a lot later than they were generated, and I do not wish to exclude those.
Oh, the new uploader will probably be using a bit more memory than the old one, a function of how I deal with threaded uploading and still clearing the cache quickly. As long as you upload decently fast (and do not have 200 endpoints) it shouldn't be problematic though ('m thinking a few MB's of ram). Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.11 17:45:00 -
[71] - Quote
I present to you, the unified uploader: http://www.evemarketeer.com/downloads
You can now add any number of endpoints, have EVE Central lagging behind all other endpoints without any trouble and it be generally awesome and out of your way.
Currently only downloadable as a zip archive, but it'll change once I've worked out all the bugs. I invite you to try it out! Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.12 17:57:00 -
[72] - Quote
Hmm, the only problem I am aware of is having to restart after autodetecting for the shizzle to work. I'll see wha I can do about these current troubles. The upload log should be working :P if it isn't showing anything, it isn't uploading. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
38
|
Posted - 2011.12.13 17:12:00 -
[73] - Quote
Counting is still off Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.13 18:41:00 -
[74] - Quote
The list is sorted based on what was last uploaded (in the region you reside in). That means the most outdated items are uploaded first. I'm not entirely sure whether it also does this for subsets.
I've also uploaded a new version of the unified uploader. It hasn't really changed much, but it should autodetect when you have no EVE installations defined and automatically search for them.
I'm also sorry to say that your totals have been fixed Vrelk I was counting the total wallet journal amount for every rat you killed Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.13 21:15:00 -
[75] - Quote
Hmm, will take a look.
EDIT: Fixed version uploaded Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.14 18:10:00 -
[76] - Quote
Controller Vrelk wrote:I will have to say, the mission page is completely confusing me. Yesterday it was a lot higher than it should have been, today it is spot on.
That's because I fixed it :) I more or less wrote than in a previous post, but probably not in a way that was clear enough.
I will try to fix most of these issues and upload a new uploader. Thank you for being my test subjects
Quote:My guess is that it breaks due to the single-quote inside of the item's name.
Correct. Fixed. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.14 20:17:00 -
[77] - Quote
Okey, the new uploader 0.3 is released.
1) It should hopefully still upload 2) It should only upload before an upload key is entered for EVE Central, it does show the message of not being able to upload with each file it parses though. 3) This happened for some reason if the uploader still had uploads in the queue when you closed it. I've now disabled closing (and I'm showing a message telling you so) while the uploader is still uploading. Not ideal, and I hope to fix that later, but at least you now know what is happening. 4) Ah, well, I of course knew about it, but opening my interface editing program was just a bit too much trouble.
5) The "wrong initial m_updatesCount value" exception should be fixed 6) The "endpoints" tab now keeps track of all mentioned things, except for the time the oldest upload was entered, this was impossible due to the way the queues are made. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.15 18:59:00 -
[78] - Quote
Config file will eventually just be placed in appdata (or home directory, for unix users).
It also seems that the uploader encounters some errors, quits processing the threads, and then continues running without end, without actually doing something. Thanks to your clear error messages I know exactly what is happening and will probably be able to fix it tonight.
I actually really want the "just go and exit this damn thing" button, but somehow, python does not allow it. Though it seems I've just found a function that does, guess I just wasn't able to find it yesterday. Thanks again for helping point out the issues! Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.16 19:56:00 -
[79] - Quote
Interesting :) this one must be from the new datadump :P
EDIT: And I'm on the uploader problem. Will try uploading for a long time myself this evening.
Oh, and you might've noticed the "EVE Central" user boosting itself to the top of the upload list. This is not a user that is pretending to be something he's not, it's just the one I've added to keep track of the quality and number of EVE Central uploads I retrieve.
I'll have to exclude him from the homepage record though :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.16 21:01:00 -
[80] - Quote
Major Thrasher wrote:another suggestiong is that the upload uploads info that hasn't been done before. for example when i start a full scan smartbomb is always first even if i just scanned and uploaded it, then restarted pc. items should update in order of longest time since upload. similar to evemarket data.
They, are.
EVE at the moment is not being nice to us marketeers in that it doesn't seem to be writing a cache file when there are no orders. Which explains why I get not upload, which explains why you always see the smartbomb first. If I receive no uploads, I cannot change the order of the list (I could change it based on what is shown, but you never know whether that is actually uploaded). Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.16 21:59:00 -
[81] - Quote
Yeah, I had been considering those options too (not with a separate timestamp, but just bumping up the last uploaded one). But I would first like to see that this is really a problem before trying to fix it.
Though it is a good idea for solving the problem of multiple uploaders per region, so I'll probably implement this anyway.
I'm not completely sure of what you hope to achieve by bumping the 'last handed out' time into the future for uploads for which it has been a very long time since the last upload. Those are generally the ones I really want to check , since I want that data. Can you explain your thoughts to me?
EDIT: Okey, never mind my first paragraph, this is a good idea regardless of what the reason for not repeating requests is. I'm getting tired of uploading Zaino Deadeye's that do not exist. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.17 09:11:00 -
[82] - Quote
Yes, I noticed the same BPO trouble yesterday. And due always trying the things that have been uploaded last, the uploader just jams when there are 50 items that will never be uploaded at all. Today I'll take a look at the uploading page and ways in which it can be improved. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.17 15:30:00 -
[83] - Quote
I've uploaded a new version of the unifieduploader. The only thing this changes is that it has function built in to log what is going wrong with the uploader threads. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.17 22:49:00 -
[84] - Quote
I know, I've been having these messages for the better part of the day, and my uploader still hasn't crashed...
What does it do? Does it simply hang? Or does it seem to not do anything anymore (but still being responsive)? Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.17 23:36:00 -
[85] - Quote
Ah, yes, I've seen it, and it's been lodged firmly in the back of my mind since then :P
As to the not uploading anymore issue, that is probably (as I've found after a day of uploading) because there is nothing for the uploader to upload anymore. After cycling trought the entire market, the uploader starts anew, but if the same EVE client is running, and nothing has changed in the market information, the cache file isn't rewritten, thus there is nothing for the uploader to do. To check this, your best bet would be to manually lookup Tritanium and see if the uploader responds to that, if it doesn't, try buying one unit of Trit and see if it works then (I'll refund it ). If it doesn't, then something is very certainly broken.
Of course, it could be that it suddenly starts uploading again when you restart the upload client, which is a practical guarantee of something going wrong. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
40
|
Posted - 2011.12.18 09:22:00 -
[86] - Quote
Seems like I'll have to grab my old and dusty two alts then to do a bit of stress testing on the uploader, it must be related to uploading from multiple accounts at the same time.
And thanks, I very much like the theme too Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
41
|
Posted - 2011.12.20 20:26:00 -
[87] - Quote
Ok, now testing scanning with multiple accounts. At the very least I've found the error that was producing the EVE central errors. Now I'm seeing the EVE Marketdata timeout errors (upload within 15 minutes), so I can do something about those I hope. What I fail to understand is how my fifo queue can upload some orders correctly, only to fail on the next one...
UPDATE: Ok, rewriting the filereader led me to probably find what was causing the uploader to hang. It found a lot of files which it wasn't able to do anything with. But these files kept heaping up, because it didn't delete them, leading to what were probably immense times for scanning files. In any case, I'll keep scanning and see what happens.
UPDATE 2: The uploader get's better and better. It's now uploading into the future I've got more uploads than file reads . I guess something is still going wrong with threading. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
41
|
Posted - 2011.12.20 22:48:00 -
[88] - Quote
I've uploaded a new version of the uploader. I hope this one improves stability, but it's still a bit stabbing in the dark, since I've yet to receive the errors myself.
And: Quote:oh god, what did you do? the market page just keeps giving me gypsy and noble implants to attempt to upload, except there's none on the market, hence no uploads......
I'm sorry, I was sorting in the wrong direction Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.21 16:00:00 -
[89] - Quote
That might be caching issues, but I'm not sure. Only time I've seen something like that was the first time I loaded the page. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.22 22:02:00 -
[90] - Quote
Yes, very feasible requests all. I'll see when I'll be able to incorporate them into the codebase. Currently incredibly busy with RL and being sick again.
UPDATE: Also very happy to hear that the uploader is still performing perfectly :)
UPDATE 2: Also, PERL and especially CPAN are absolutely terrible... Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.23 19:01:00 -
[91] - Quote
There simply might not be anything to upload (even if the upload suggestions are still happily cycling, if nothing has changed since last time, nothing will be uploaded). The EVE client won't even write a cache file, so the uploader does nothing at all. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.23 19:35:00 -
[92] - Quote
Controller Vrelk wrote:That was it, good to know. I cleared my cache just to see if that was it, and it was. I thought the uploader deleted the cache files after uploading them.
It does delete the actual file, but it doesn't clear the same cached information inside the EVE client, which for some reason also saves a copy of the data in it's memory
Why it writes the cache file to disk and additionally stores an in memory copy in addition is a big questionmark to me, but I'll happily make use of it Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.23 21:48:00 -
[93] - Quote
Are you certain it is going in circles? I cannot duplicate this behaviour... It should be easy to test by seeing if the items that are shown first are different if you refresh the page. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.24 09:52:00 -
[94] - Quote
Hmm, for some reason mysql decided that it'd had enough. More, the server seems to have decided it was enough, and it has been rebooted by my hosting provider because it was unresponsive. (Now, that is awesome, except that mysql didn't work afterwards). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
43
|
Posted - 2011.12.25 08:56:00 -
[95] - Quote
They are escaped before adding them into the query, that said, it's a bit weird they actually break it, but probably because the query expects them all to be numbers.
Thad said, I"ve added it to the feedback page and will see if I can fix it.
As for the Win XP error. I guess that's what I get for trying to lend stuff from EMD, the odd part is that it's actually designed to do that differently for XP, so I guessed it should work. Will fix in next version. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
43
|
Posted - 2011.12.27 01:52:00 -
[96] - Quote
Invictra Atreides wrote:Is this a normal behavior? I don't understand.
It both is, and is not at the same time. The server was rebooted yesterday, and wasn't running any processing threads due to them all being killed because of that. It should be updating normally now. Anyhow, I really need to start doing this automatically, as these are situations I like to avoid, so hopefully this problem won't occur again.
If you ever wonder whether anything is happening to your updates, you can look at the upload statistics page. If the EVE Marketeer backlog counter keeps increasing, something might be wrong with the processing (but your uploads are still saved, and will be processed when the problem is resolved). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
44
|
Posted - 2011.12.28 10:13:00 -
[97] - Quote
Well, it isn't that the database is corrupted, it is more that EVE Central keeps sending empty data at times. I thought I'd fixed the problem where empty EVE Central data was sent, but it seems not. I built in the restore button in any case, so you can go back to correct data if you think the data can't possibly be right.
I'll see what is happening to make some data still being cleared. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
47
|
Posted - 2011.12.29 09:36:00 -
[98] - Quote
I am not aware of battleclinic supporting direct uploading. If and when they implement one of the upload formats, they will publish an endpoint url that you can add to the uploader. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
63
|
Posted - 2012.01.01 18:11:00 -
[99] - Quote
@Rektide: There are still plans for streaming output using AMQP, but at the moment it's not very high on my priority list. I might be able to simulate something EVE Central like for the interval though.
@Scrapyard: I know, there is something going wrong with the way those values are calculated. I'll investigate the issue. Same goes for regions, though I have no clue as to what is causing that yet.
Good to hear that the unified uploader is running happily. I wonder what is causing the large memory consumption though. How long have you had it running? Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
63
|
Posted - 2012.01.03 23:17:00 -
[100] - Quote
Ok, I guess that means it's not a very radical problem, and it explains why it hasn't shown up in my tests. Will still see whether I can do something about that, but my guess is most people don't leave their computers on for 9 days ;)
In addition, if any of you ever wondered what your wallet balance graph looks like, which I guess you didn't since we all know of EVE Mentat and all those programs, I've always felt that such a function was missing on EVE Marketeer, so I've added it.
Find it under My Market -> Wallet History Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.04 10:38:00 -
[101] - Quote
And you did upload more history than November I take it? :P It wasn't on my to do list yet thanks for letting me know. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.05 18:58:00 -
[102] - Quote
Quote:Yes, the history tab needs to be open for the client to make calls to get history (and in turn end up in the cache files). Thanks for answering that question :)
Quote:When you get a history with a single entry, and 0 orders/0 quantity, can you somehow depriorotise that item for that region, so it is hardly ever requested when scanning the market? Yes, this seems like a smart idea. Will probably try something along the lines of what Scrapyard Bob described a while back.
Quote:Oh, and when uploading item history, nothing seems to be coming up in my upload history? If you are using uploader 0.4, you should switch to 0.4b, but I assume you have done that already. I'll investigate this issue.
Quote:Would it be possible to add the 'field_filter' component to the 'station_info' (station details) request ?
I'd like to get a particular have info as precise as possible and sometimes artificial orders are messing up with the values of the item I want in the simpler item details. Yes, I'll add the field filter, I was under the impression it was there already, but it's not. Can you describe artificial order? I do my best to remove all artificial orders, but maybe someone came up with an idea good enough to pass through the filters .
It's also possible to not delete the files, but it'll probably move them to a different folder then, since it's going to interfere with the uploading otherwise (especially if people leave their client running for weeks on end , it's bound to get slower). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.06 22:29:00 -
[103] - Quote
Yeah, it's version 0.4b. Probably forgot to change the version numbering (again).
The text is constantly flashing because it is being updated... I can lower the frequency though, which should make it better. On the other hand, I can hardly believe you actually spend time staring at the loveliness of uploading Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.07 09:25:00 -
[104] - Quote
Yup, I already got that 4 posts ago it will be added. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.10 17:32:00 -
[105] - Quote
Hadn't seen eve market guide yet. Will loot their functions :P though EMK has everything but their invention prices, it's not yet as accessible.
As to scrapyard, good suggestions, will do. Sorry, haven't been able to work on EMK much the past week Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.10 21:41:00 -
[106] - Quote
Ok:
- Field filter for station API - Fixed orca price graph, and hopefully other outliers that are too mad to be true - Added the group summary pages, will still need some (lots of) work - History mouse over is more readable
These were the things that were easy to add :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.11 09:26:00 -
[107] - Quote
Lolz, yeah, there was something wrong with the algorithm that is used to determine the top regions. I just couldn't get it right, so I'll probably allow people to set their own regions there, it's just going to drive me mad otherwise. The default would then be to show the top 4 general market regions.
I didn't do sell/buy averaging yet because sometimes either of the values is zero, and that would mess up the average. Catching that will take a little more time, but don't worry, will be done.
Changing page titles, smart idea! Currently they only change based on the page you're on, but it's perfectly possible to add additional information.
Going to the right sell region automatically is more difficult, though I guess I can solve that in some way (it's not that is actually difficult, it's just that I"ve made it so :P).
Market history needs some love indeed. The reason I didn't do this yet is that a while ago, CCP released a dump of their history data, and was talking about providing all of that automatically, which I thought was pretty awesome, as it would erase the need for history uploads. Haven't heard anything about that anymore though.
Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.11 16:20:00 -
[108] - Quote
The version that is currently online determines the regions based on market activity (or it should, anyway), but I've developed a new version today that allows you to set your own regions. I'll put that version online shortly, first I'll finish my awesome new table engine. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
67
|
Posted - 2012.01.11 23:22:00 -
[109] - Quote
Uh... the forums ate my previous post announcing the latest changes...
In any case, sorting by name is probably the way to go. People will start searching for a name as soon as they find that almost everything is sorted by name, and then a few groups with custom typeID sorting will probably not make much sense.
In any case, this page will be ported to the new table grid as well, which allows sorting of any kind. Just have to add a column for typeID. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
68
|
Posted - 2012.01.12 12:06:00 -
[110] - Quote
Yeah I've long been planning to grab every fuction I could find in any market program anywhere. It's just that these other things keep comin up. My attention seems to swing to whatever is closest at the moment though.
A while back someone asked for something to calculate character value, and yesterday I suddenly felt like I could no longer do nothing with that request, simply because I was curious what my own value would be . The page looks butt ugly though (My Characters). Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
68
|
Posted - 2012.01.13 16:54:00 -
[111] - Quote
Can do! Was already planning to add the featur that remembers your settings, for all those kind of useful dropdowns that currently keep forgetting your settings :)
I've also been calculating that information (averages) for a while, it was just never exposed. I'll not include it in the info API though, since I'm never sure about history information, and always sure about what is currently in the Info API. Will do what I can about adding it though. Probably first a separate API.
Best items is sometimes a bit fickle, especially when a day has just begun. The interval shouldn't be too long though... Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
68
|
Posted - 2012.01.13 18:58:00 -
[112] - Quote
It might have had something to do with a completely different problem that the website was suffering from. Which is now fixed. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
68
|
Posted - 2012.01.14 11:27:00 -
[113] - Quote
Top Uploads
EVE Central 581214 Scrapyard Bob284262 oshua 133149
Those two have been doing most of the uploads in the entirety of the EVE universe for the past week. The EVE Central number is all the orders I retrieved from EVE Central, whether they were also uploaded to EMK or not.
This means that there (if these were both uploading to both sites) were only 163803 uploads that were uploaded uniquely to EVE Central. You've got to love multiple uploading ^^
Much respect to the people whom are doing this great service to the community by providing half of ALL the order data the market sites receive by themselves. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
68
|
Posted - 2012.01.15 09:31:00 -
[114] - Quote
Quote:Both of them have multiple accounts who are running the scanner all day long. I only have one account so I can't have the same numbers. I didn't mean to say other people didn't do their best I just found it incredibly funny that two people are actually doing half of all the uploading Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
69
|
Posted - 2012.01.15 19:57:00 -
[115] - Quote
The red green lines mean whether your orders are the lowest/highest in the region/station they are sold/bought in, depending on whether you selected station range, and whether they are buy or sell orders.
@Scrapyard: Can you possibly have missed the fact that the second table on the top uploaders page is sorted by amount of credits? The credit system works as you describe , the minimum value is 0.1, for an upload which add absolutely nothing (see, repeat uploading), to 25 for an upload that redefines the stats for the entire region. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
69
|
Posted - 2012.01.16 06:55:00 -
[116] - Quote
Ah, true. I'm not entirely certain which one I use for the front page, but I assume it's upload count. Mostly because showing an arbitrary number of credits doesn't mean anything to the uninitiated. Maybe it can be changed to 'best uploaders', though not entirely certain how to make that comprehensible. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
70
|
Posted - 2012.01.16 07:12:00 -
[117] - Quote
It seems sensible enough, just wrong. But I'll take a look at the unified uploader, and fix this. Thanks for the report :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
70
|
Posted - 2012.01.16 17:19:00 -
[118] - Quote
Can you check the log files in the installation folder and see if you find anything unusual? Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
70
|
Posted - 2012.01.16 20:20:00 -
[119] - Quote
Ah, yes, the uploader doesn't really care about CachedObjects at all, the only thing it's interested in is CachedMethodCalls, which should be empty.
I take it it is uploading okay otherwise? With the exception of your CachedObjects folder staying full (which the uploader is not having any effect on)?
Also EVE Central might have some trouble keeping up with the uploads you are doing if you're running 3 clients at the same time, it'll just permanently stay at a queue of 50 items, and discard any excess.
@Kaladr: Fixed the URL scheme, will be included in the next iteration of the UU.
UPDATE: For those of you reading this, EMK likes it when you request item information in batches of 25 instead of one at a time :P or even better, if you're going to request them anyway, all the items in the region at the same time (and discard some of the information).
Also, I wonder who the person is that is uploading 4 orders per second with (seemingly) the old uploader, may have to add the user agent string to the uploader too. Would be able to make more sense of the access log that way. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
71
|
Posted - 2012.01.17 06:54:00 -
[120] - Quote
Jup, the next thing I will add to the uploader is the ability to either move or not delete the cache files. It was just the easiest solution to delete them at first :) Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
71
|
Posted - 2012.01.17 20:09:00 -
[121] - Quote
Damn, the forums ate my post again :S
As far as I know there is no way to retrieve either LP or faction prices (contracts) from the database. That means I could build something that allows you to input your own data, but it'd be kind of pointless. If the data is somewhere in the SSD though, it could be useful.
@6ie: Is mentioned somewhere on the previous page, basically means, the more influence your uploads have on the state of the market, the higher the reward. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
72
|
Posted - 2012.01.18 11:23:00 -
[122] - Quote
The history data that is provided by CCP is based on transactions, so that is a fairly accurate indicator of the movement of the market. I do some more interesting things, like checking whether the average over time is closer to the highest or lowest price to determine whether there are more buy or sell orders being filled.
Today I found out that Jitanomic, the bot driven market information website had the information on loyalty points. I've tried to find it in other places, but wasn't able to find it, which must mean that it isn't normally available. Having no compunctions whatsoever about leeching off a known botter, I proceeded to scrape the website, which is now happily running :P
Hopefully means I will have some information on loyalty points, making only the faction item prices an issue of manual input. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
72
|
Posted - 2012.01.18 11:46:00 -
[123] - Quote
The reason for that is pretty simple. I've found no way to get the data from the API, nor from the static data dump. CCP doesn't make a habit of providing data to a single person (as in I've never heard of it happening), so the easiest solution available is getting the data from someone else.
I could ask CCP whether I have missed something, but I estimate they'll answer with 'not possible'.
This saves me both the time and trouble looking for it. That said, will have to verify it is actually accurate, there is a number of websites containing the information already, but they're either not up to date, or inaccurate (entered by players). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.18 19:50:00 -
[124] - Quote
You must be kidding, I'm not going to do that to myself (creating OCR?), or to you guys.
I should probably make something clear. I'm not relying on ANY bot to get the data.
I've retrieved it once from the website, and now I can use it forever (unless CCP changes LP prices). In addition, for all I know the original data was obtained in a perfectly legal way, there is no way for me to know. The only reason I think it might have been obtained by bot is that the owner of the website in question freely admitted to botting and code injection on his/her blog.
That said, it's probably a good idea to send CCP a petition questioning whether it is alright to go ahead and use it, before I get my ass banned because I was too lazy to ask :P Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.19 07:25:00 -
[125] - Quote
In this case, I do not think it would be bad to use the data. There are other sites containing the exact same information, where I could've gotten it from too. Besides, I do not think this really constitutes an unfair game advantage, so there is no reason for the data to not be public anyway (in my opinion). Besides CCP time limitations anyway.
Using data from third parties only bothers me if I can think of ways to misuse it. Anything that saves typing and generally decreases the amount of spreadsheet fu involved is a generally a good thing in my opinion.
Anyway, a petition has been sent. Now I just have to wait for the results. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.19 16:56:00 -
[126] - Quote
I advise you to wait with writing out the data until I can fabricate a web form. Otherwise I might not be able to parse it. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.21 13:22:00 -
[127] - Quote
Ok, got something else updated today. The market scanner page now allows you to choose between history and order uploads (be sure to use the same setting for the market window in your client!), and dynamically shows how well updated a given region is. You can now see your contribution actually mattering again. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.21 14:39:00 -
[128] - Quote
Have you had the lag issue before? I never heard anything about it before, and it seems to work perfectly here. At least have not noticed any oddities.
Anyway, the start stop button was ugly, but I might add it again next to the group dropdown if it's really a problem. Isn't it still possible to set it up so that it works by just switching the window positions (Market on the right hand side, browser left)? Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.21 15:03:00 -
[129] - Quote
In that case, I think it must be the client, as the code for the countdown has been like that for over half a year :P
I agree that having the close buttons visible makes more sense. I'll see what I can do in that regard.
The error on the group summary page is probably due to an old bookmark, if you change the decision dropdown to what you want to see (or to and from another) it should be fixed. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.21 20:21:00 -
[130] - Quote
What's selected to be scanned is based on what region you are currently in, and what is most outdated in that region. The problem where multiple clients in the same region would upload the same things should have been fixed.
In regards to the size of the images, it is a matter of taste, but there's nothing else to show on that page, so there is no practical reason to make them tiny (and it might have something to do with display resolution :) ?). Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.24 17:21:00 -
[131] - Quote
Have you tried restarting it? :P It should be an issue with the autodetected cache folder, so in the worst case, removing that from the config file and starting the uploader should work. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.25 09:00:00 -
[132] - Quote
Ah, yes, that could be the case. If only one of the clients updates, the uploader will still use the most recent cache folder (in this case, only one client) and thus, all uploads from the older clients will not get registered. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.26 20:22:00 -
[133] - Quote
Good to hear your problem has been solved.
I've updated the EMK database to use the 1.1 crucible data dump. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.27 07:53:00 -
[134] - Quote
Yeah, I'd seen it, but I could not come up with a satisfactory reaon for why it was happening, so I deferred fixing it till the weekend Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.28 11:02:00 -
[135] - Quote
Sure! I just don't know what people generally want, so it's a bit difficult to come up with logical global groups. I'll see if I can add a global PI group.
UPDATE: PI group added. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
76
|
Posted - 2012.01.28 14:56:00 -
[136] - Quote
Yup, that would be easier indeed, but it would also be more intensive in terms of resources and time spent developing it.
As this is the first time someone actually asked for an addition global group, it hasn't been very high on my list of priorities though someone did suggest something like that before.
Anyway, I'll get around to doing it 'sometime'. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
77
|
Posted - 2012.01.28 21:09:00 -
[137] - Quote
Just uploaded unified uploader 0.5, which has support for not deleting cache files, and a few tiny other fixes. I hope you will use another program to delete the cache files though, or the unified uploader is going to eat you disk alive (and upload much slower, because it's ploughing trough thousands of files to find one that is actually useful) :P Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
79
|
Posted - 2012.01.29 10:55:00 -
[138] - Quote
Ah, it adds new items about every 15 items. However, it doesn't really matter whether it is uploading in the exact region it thinks it is uploading.
I could explain it in more detail, but it'd be incomprehensible (believe me, I just tried writing it down, and it failed). Suffice to say that while the upload page thinks you are in a different region, the eve client knows the exact region very well and therefore uploads correct data.
That said, having region detection on the uploader page is a good idea, if just to give you an idea of where you think you are currently uploading. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
79
|
Posted - 2012.01.29 14:31:00 -
[139] - Quote
Lolz, yeah, it sais that every time it starts up, just to remind you :) (the old uploader at least)
I would also reccommend using the unified uploader 0.5, as that one works much better than the previous one.
The upload ID (or key) is the key the website gives you to identify the uploader of the data with. In the case of EVE Marketeer, it is shown on the market scanner page (when logged in). Or in the account menu (also when logged in :P). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
79
|
Posted - 2012.01.29 18:11:00 -
[140] - Quote
Ok, let me clear up a few points.
The Unified Uploader is preferred, but not yet fully tested (although functional), that's why I haven't deprecated the other uploader yet.
The 'upload key' is for all intents and purposes identical to the 'upload id'. Any reference to 'upload id' is purely accidental and should be 'upload key'. However, I believe EVE Marketdata calls it Upload ID, and EVE marketeer calls it upload key.
This software uses reverence, and deleting cache files can hardly be seen as a criminal act. It isn't criminal if I delete the EVE client folder either. In any case, as far as I know nobody was ever banned for deleting cache files, and multiple uploaders have had that feature for a very long time.
I'll take a look at the points you mentioned. Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
81
|
Posted - 2012.01.30 20:56:00 -
[141] - Quote
You cannot upload with just the IGB. The IGB page merely provides the infrastructure of the cache scraper (Unified Uploader) to do it's work. I think it should be possible to get the unified uploader working on Unix. It isn't a program with a lot of dependencies I think. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
81
|
Posted - 2012.01.31 07:01:00 -
[142] - Quote
Aw poop, and here I was thinking it should work fine :P
Back to the drawing board I guess :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
81
|
Posted - 2012.01.31 18:26:00 -
[143] - Quote
@VV
1. The think you propose would not really be an usablity improvement, since there's almost always an exact match in the searchfield. There would be no option to browse anymore if I did that. That said, just clicking the search field, not deleting anything, and pressing enter should do the trick.
If anyone agrees with VV, please tell me, because this may just be my misconception as the one who built it.
2. It should be possible to give the downloaded data a different automatic filename than the URL, if that is possible, this is a very plausible and useful suggestion. Otherwise, because this API is generally used by programmers, I do not think I will change this, since it would require me to do a lot of lookups in tables (for the names) that would make the API slower, and I want that to be as fast as possible.
In that case, it might be possible to duplicate the same functionality with a different call, which shouldn't be a problem.
3. Nah, I don't delete data, but the data goes only back 2 years or so, so I should be safe for a long while yet ;) The full stored history is already available (history API call). If you know a place where I can get history that goes back further, please let me know.
@Nebu Retski: The client cache URL is actually not in the config file at all. When you start the client for the first time, the cache location is automatically determined (and saved to the config). The string you saw was thus the URL that was automatically determined.
I'm very interested to hear whether it works.
@Endeavour Starfleet: Yes! I've gotten a reply to my petition, stating that I am free to use the data (or rather, that they cannot forbid me to use it :P), but that they cannot guarantee the accuracy of it. This means that the nature of the trouble is going to change to checking whether the data is correct. If it is not, we'll have to manually enter the stuff anyway. Since the query to get the information is nearly ready, I'll have this function up soon :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
81
|
Posted - 2012.01.31 20:41:00 -
[144] - Quote
Yes, I understand what is happening, no trouble there :P
Or was this for other people? Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
83
|
Posted - 2012.01.31 22:38:00 -
[145] - Quote
Awesome, happy to hear it's working :)
I also added two new pages to the website. I've found that I gather a lot of data, but not nearly everything is exposed, which is why I am now trying to at least show all the API information I gather.
The first two pages are Industry Jobs, and Wallet Information for corporations (Industry Jobs for characters coming soon). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
83
|
Posted - 2012.01.31 23:02:00 -
[146] - Quote
Lol, looks quick and nasty indeed. But it works, and that's what important Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
83
|
Posted - 2012.02.01 16:08:00 -
[147] - Quote
Okey. I've added the insanely cool ability to find the items in LP stores that give you the most ISK for your LP. You can select either by sell or buy orders, but obviously the buy orders give you a more senseful result.
I've also added a feature to the item information page where you will be able to see the places where you can get that item in loyalty point stores (if it is actually possible to buy it somewhere).
Oh, and for the people who do not know yet, you can get the links for IGB features when you right click on either item or location links :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
83
|
Posted - 2012.02.02 16:39:00 -
[148] - Quote
6ie wrote:Every time I clicked the \Q/ I got 1mill in my bank account
Damm! That feature was supposed to be VIP only :P
Will reply to other stuff when not on phone. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
83
|
Posted - 2012.02.02 18:27:00 -
[149] - Quote
Quote:Awesome new tool with the Best Loyalty Points functionality. Is there anyway to restrict it to a certain type? ie: caldari navy LPs, or Amarr Navy, LPs, etc? Not yet, but it is on the backlog :P
Quote:Any ideas / plans yet on adding "virtual" regions to the list of regions? You'd definitely need to do the calculations based only on orders downloaded within the past 7 days. I have long been thinking of adding virtual characters, but virtual regions are new. That said, there is no reason not to add them. Are you talking now about arbitrary regions combined, or arbitrary security ratings combined?
As far as I know, the scanner does not auto restart. Have you experienced that behaviour?
Quote:What is the \Q/ at the top of the screen for? The Q at the top of the screen is meant to be a quicklist for items and destinations (stations, regions, etc) that you can quickly click or view. So far I have failed to find a satisfactory format though. You can add some items by clicking on 'add to emk quickbar' on the item information page.
Quote:One interesting statistic that I'm curious about: What systems have the highest trade volume per day, maybe a list of those where the 7-day moving average puts them into the top 25 systems. Repeated for regions too. The Statistics/Market for the regions is interesting, but since there's a ton of "junk" orders for outrageous prices, the "Sell Total" number isn't very accurate. And that's with a lot of junk orders already filtered out. It's too bad I can't filter items for which there isn't anything else on the market for reasonable prices. A 7 day moving average for transactions seems like a very plausible way to check market volume. Will do!
Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
84
|
Posted - 2012.02.03 06:54:00 -
[150] - Quote
Gabba Cyno wrote:How many IDs can be pulled per importxml? Here I was thinking you people were all idiots because this information was on the API page, but it's not, so I apologize. Anyway, the limit is 25 per call, and I'll soon add that to the page. Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
86
|
Posted - 2012.02.03 20:13:00 -
[151] - Quote
@6ie: Absolutely correct :) I built in the second page to allow people to type in arbitrary things like 'caldari carrier' and still have the option of finding whatever they were looking for. The old search was pretty restrictive (though less restrictive than other sites :P).
I agree however, that when you click the dropdown, it should take you to the item immediately. Will fix that.
@API trouble: Ah, yes. The server doesn't like it when you query for the same thing twice. Or rather, it doesn't bother returning it twice. If you really need that functionality it may be better to just query them all independently. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
88
|
Posted - 2012.02.05 08:20:00 -
[152] - Quote
Thank you.
I added PI information (for PI items) and filtering for the best loyalty point items this weekend (and some small things which I forgot). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
88
|
Posted - 2012.02.05 19:51:00 -
[153] - Quote
Scrapyard Bob wrote:Lots of stuff... Fixed it all :P Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
88
|
Posted - 2012.02.06 21:21:00 -
[154] - Quote
Ok, let me see:
Quote:30-day average price drop-down on the LP page, doesn't seem to actually work. It's still displaying the sell. Yes, it was not correctly registering what was selected. Fixed it now.
Quote:There's one feature that I heavily used in the past, on another similar and awesome website: an items basket. Would be useful, will see if I can combine the item info page and the quicklist to do something awesome if your screen is wide enough, since quicklist isn't actually quite as fast as the quicklist you propose.
In addition, yes, the quicklist should be updated directly, but I haven't had a chance to do that yet.
Quote:I added PLEX on quickbar and everything exploded! Ehm, yes, it seems there was a problem with escaping in my search alghoritm, I apologize for any distress it caused you, but I assure you it didn't have anything to do with the quicklist :P
I use them almost everywhere, except in the really complex queries where my brain absolutely needs to see what I'm referencing.
Quote:"Add to EMK Quickbar" is pretty nice but once that item is added, when showing this item again, the link should switch to "Remove from EMK Quickbar". Agreed, done.
QUOTE: The LP Stores tab lists all LP items, not just entries for the item being viewed
It just looks like there are a LOT of locations where you can obtain that item to me, no different items at all (all LP and ISK cost is the same, the only thing that differs is faction, corp and location). Can you screenshot this one if you really think there's something wrong? Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
89
|
Posted - 2012.02.07 06:54:00 -
[155] - Quote
Solved now? If not, what are the pages? Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
89
|
Posted - 2012.02.07 17:36:00 -
[156] - Quote
Correct, I'm not catching this kind of stuff. The most important problem is that it keeps the website from functioning however.
It seems something was eating up mysql connections, thats my first guess anyway. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
89
|
Posted - 2012.02.07 22:22:00 -
[157] - Quote
Nope, not blacklisted. Seems the problem had something to do with InnoDB. Stupid innodb size... I hope it has been fixed for now. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
89
|
Posted - 2012.02.08 09:02:00 -
[158] - Quote
Jacob Lyon Chieve wrote:Having issues once more. On mouseover, the cell containing the XML call says "error: the XPath query did not return any data"
FWIW, I can get onto the website just fine.
This might be because Google caches the request your xml call makes for a while, so it remembers whatever happened when the site was down. If the call you are doing by XML is going wrong if you enter the URL in a browser, please give me that URL, so I can investigate.
Quote:If you're running out of database connections then you have something not releasing them correctly some where. Make sure when you're done with the connection on a page you set you variable for your connection to NULL should help make sure it gets released. Something like $mysql->close();$mysql=NULL; works wonders at times Ah, turns out it wasn't connections, but InnoDB log file size, the odd thing is that it continued to work until it really couldn't do anything anymore. I do not exactly understand the reason, but the size has been increased and I do not expect to see this problem again.
- in the API description for the historical averages, the description for 'averages', 'maximum' and 'minimum' are wrong. Those refer to the item volume, not transaction count.
I think you are quite correct. Number of transactions is a meaningless number anyway. I'll fix this to state what it means correctly.
- When querying using station_info, in the returned document station_id is null
Ah, yes, this is an unfortunate artifact of not saving the station id when orders are added together. This will probably change some day, but as you already know what station it is when querying, it isn't exactly high on my list of priorities.
- How are you estimating the sell/buy percentages?
Using magic! No, the calculation is simply to see whether the average lies more in the direction of the highest transaction that day, or the lowest transaction that day. High has a good chance of being sell, low has a good chance of being buy.
- I'd very much like to have the historical data expanded to have a row per day, instead of just one averaged for the whole period. Would you consider doing that?
I thought this was already possible! Where the hell has my history API gone... Anyway, will be added ASAP. UPDATE: Yes! I already had it, but it's not on the API page: http://www.evemarketeer.com/api/history/24698/10000002/xml Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
91
|
Posted - 2012.02.08 21:37:00 -
[159] - Quote
Filtering the days will probably not make it much faster to load, but it will make it easier on you to use ;) I'll add that to the list of stuff to do :P
In addition, I've added support for character groups today, which will allow me to do some very cool things that some other market programs already do. For more information, see the newsitem on the website. And please report any issues you find. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
92
|
Posted - 2012.02.09 07:28:00 -
[160] - Quote
Damn, the reproduction of the problem is bothering me. I cannot. I'll try to enter a nice new check in the page to see exactly what error is occuring. Seems it had little to do with the mass of errors I fixed in the mysql log.
I suspect my changes to yapeal are to blame. Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
94
|
Posted - 2012.02.10 19:49:00 -
[161] - Quote
Fixing it now
UPDATE: Should be fixed now. Will continue to monitor over the weekend. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
94
|
Posted - 2012.02.11 08:24:00 -
[162] - Quote
Oh, yes, sorting should be something that is easliy implemented, but very handy to have.
Regarding the LP store items: I agree with you that it should be done on a different corporation page (listing all the stations), the loading is not the issue for me though :P just that 3300 items are not very reasy to browse :) Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
96
|
Posted - 2012.02.12 14:19:00 -
[163] - Quote
Ok, today, fixed the manufacturing page, which had been unreliable for quite some time. I dropped recursive building for the moment, since it made the results look pretty odd. You now see what you see ingame as well. It also takes into account a few edge cases, most notably recycled items and extra materials which also show up in the base materials. This is not as much a feature, as an overdue fix. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
98
|
Posted - 2012.02.13 20:47:00 -
[164] - Quote
- Basically you put the Z-order (at least for Firefox 10.1) of the mouse over tool tips in the main page above the Z-order of the items found drop down.
Ah! Correct, I'll fix this soon.
- I entered plex then pressed GO and the website displayed a Could not find 'plex' screen. So far so good.
Umm, yes, it seems I started working on search, then forgot I was doing so, and started implementing different things. I'll fis these issues tonight.
- Maybe the search box needs to be smart enough to let us search on item ID numbers? :)
It should be, unless I broke it. If so, will fix it now :P
- For computing buyHighest5% and sellLowest5% you should do some pre-filtering on the orders. Right now, the numbers are often biased by existing but irrelevant orders like the token region-wide buy order for 1 millions units at 0,01isk. There are many ways to do that. A simplistic approach would be to discard buy orders below say -80% of the highest buy order, or something like the median of orders whose remaining volume is smaller than the initial volume and are not older than x.
There should be a lot of filtering done even before the orders actually get into the database. I've seen indications before that this wasn't correctly happening, but since I haven't received any reports on it thus far I've let it be. Will put checking this on the agenda for asap. A mechanism much like you describe has been implemented, using the highest buy order (or lowest well) as a measure is a smart thing though, and I'll see if I can add that.
- When using the station_info API, the datetime column is missing (it's there for the otherwise identical info API).
Hmm, yes, this seems somewhat odd. I'll see if I can't add this in an easy way (due to the calculations being done on orders it's not automatically and representatively there).
- I'd really like to a) query up 25 typeIDs in the history API and b) specify the time range. I'd rather do 210 small queries that way instead of the current 5247 when I update the history, pulling like 300MB of csv data in the process
a is probably not going to happen, as the history queries are quite intensive as it is (biggest table in emk). b is on my list for implementation (well, limit, but date range is probably even better) :)
- You are tracking more items in the DB than just the subset WHERE marketGroupID IS NOT NULL AND published = 1. Why?
I shouldn't be, it should even be a little less, as I'm not interested in tech 2 BPO's. Where are you getting this number?
The search makes absolutely no sense.
It actually does, it's just smarter than you, and tries it's best to find things with 'mega' and 'af' in it. It didn't give any preferential treatment to the first time though, nor to both items following eachother, which would be a good addition. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
100
|
Posted - 2012.02.14 06:56:00 -
[165] - Quote
Vaerah:
2) Price filtering is not optional now at this moment (though if it ain't working either I guess it makes sense I don't get complains :P), but I've long been planning to just mark the suspicious orders, instead of delete them.
3) Good thing about low prio stuff is that it generally only takes a few seconds to do it :)
4) you can still select 720 or 1800 and use the zooming feature, but I agree that setting dates might be more intuitive. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
100
|
Posted - 2012.02.14 19:00:00 -
[166] - Quote
Maeste Madeveda wrote:I have tested the T2 reprocessing and it seems not to beat the benefits the reprocesser finder finds. Any info on the calculation method ?
What exactly did you try to say? Is this good or bad? I noticed that my new calculation method that makes use of the real trade value of items has some flaws :P since people really are stupid enough to buy WAY above price :P Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
100
|
Posted - 2012.02.15 09:47:00 -
[167] - Quote
As far as I know, when reprocessing, the base materials, minus a percentage are returned. I've never actually tried reprocessing a carrier to see whether I could get back the capital construction components though. But this is the premise that reprocessing profits are based on.
The new calculation method takes this into account when determining the prices of the items. It also doesn't count lower than one level, which was messing up the previous calculation (if there were things in the extra materials list that were comprised of base materials, it would still count them as base materials you'd get back for reprocessing, which wouldn't happen of course).
The only problem I'm aware of regarding reprocessing stuff now, is that some prices are unrealistically high, but the idiotic part is that I'm now using the average price of the last 30 days (according to history data), which should be pretty accurate. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
100
|
Posted - 2012.02.17 22:57:00 -
[168] - Quote
Damn, damn, I knew this would happen. I'm gone for a few days, and people are cheering me on and requesting even MORE features :P
That said, I've been away for a while because I have been busy fixing my companies production server, which broke down for one reason or another, that I still haven't been told. All the while, the EMK server was running fine, which made me feel exceptionally stupid. I'd rather have you all angry than my clients, but **** happens I guess :P
As a side effect, both my new production server (at the same place where EMK is hosted) and the EMK server are now costing me about 10 dollars a month more, but also fully back upped every day.
Quote:Only if you don't shut down the uploader before patching. Every time the EVE client patches, it moves the old cache directory out of the way and creates a new one. I suddenly understand why EMD has this HUGE warning about this that pops up every time you open the uploader :)
Oh, and will log all feature requests, but probably not work on them for now, as I'm still firefighting
Quote:I second what Vaerah said. Plus I haven't found any way to delete already written lists.
On the subject of processing, you might want to check why the reprocessing values of JF are over 100B. I guess it's because of the prices of capital parts that a dumb someone is putting on the market. Ehrm, yeah, the custom list mechanism is quite old, and the interface has changed a bit, plus, I haven't added all the buttons I probably should've added.
To create a custom list, you first enter a group... now wait, I just checked, and I broke it completely when rewriting the uploader interface. I didn't even modify any part of it, but somehow it is broken now. It'll give me an opportunity to make it somewhat nicer that it is now.
Quote:4) Total traded ISK volume per market hub / system / region over time for the top (8) stations/systems/regions. I do not think it is possible to do any more than checking this for a region, but it will still be interesting. I had the power to do it for individual orders once (thus also enabling hub/system stats) but I've disabled recording every trade a long time ago. May start it again some time though (still have the function more or less built in). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
101
|
Posted - 2012.02.18 17:25:00 -
[169] - Quote
Snarf Aldes wrote:Both on the order info on the site, and the info provided by the api, when i look at Sterile Conduits (id = 2875), i don't see any buy orders with a minimum quantity greater than 1. There are at least 2 buy orders in in Jita 4-4 at the moment that don't show up (one with 200 and one with 1000 min. qty.)
Is it a bug or a feature?
thnx.
This is a feature. Orders which have a minimum quantity higher than half of the total quantity are filtered, because they are likely scams. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
101
|
Posted - 2012.02.19 14:30:00 -
[170] - Quote
This seems like an issue with updating and keeping the uploader running while doing so. In that case it might not detect the items you are uploading. Otherwise, I have no idea why it is negating your manual items.
Just to make sure, you have selected the history tab in the market view (that is, not the website page, but the ingame market browser) have you? Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
102
|
Posted - 2012.02.19 16:59:00 -
[171] - Quote
Is it possible your own caching script is deleting files right after they are read? Or locking the files and not freeing them again?
Basically, if you do this:
1. Start uploader 2. Start game 3. Click on item in market window (history or orders)
The uploader should upload. If it isn't doing something along that path, something is wrong.
Version 0.5 (fixed in 0.6) read all already existing cache files on starting (the uploads you saw) and tried to upload those, but 0.6 ignores them, because it led to duplicate uploads. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
103
|
Posted - 2012.02.20 20:41:00 -
[172] - Quote
Vaerah Vahrokha wrote:As you see no log nothing despite the items I am uploading were last updated yesterday.
If I go in "recent uploads" I see nothing have been uploaded. It worked with uploader 5 (with some issues I posted in the past). I put the upload key in the Endpoints as well.
Starting from version 0.6, it will not upload anything that is already in the cache when the uploader is started. In addition, the default EVE problem of only updating the item only once every time you start it unless something changes (for history, probably only once a day), probably applies.
Can you tell me whether the steps I outlined above work? You should follow those while you have no application (well, not EVE or the uploader anyway) open.
In addition, you should really delete some of the cache files eventually (or move them.. I forgot to add that option...) or your EVE market seems to get really slow.
I may have to write an essay about the intricacies of those damn cache files :P Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
103
|
Posted - 2012.02.21 18:28:00 -
[173] - Quote
Quote:1) It won't send current day data (which is ever changing, therefore would always trigger a send).
2) History mode basically is a one run now. Therefore the play button should only run through the selected category (i.e. minerals, PI...) from the first item to the last item once. Once at the end of the list, it should not restart from the beginning of the list like it is doing now and restart the cycle forever. This seems a plausible explanation. Making the history not cycle is not really a solution though, in my opinion. People will generally leave the uploader running when they aren't doing anything else, so stopping after one cycle wouldn't make much difference, and just annoy people whom would want to keep uploading all the time (though downtime would eventually kill that anyway, I admit).
Still, for others, it might be a good idea to just make a checkbox or separate start button that will start just one cycle of the uploads.
Quote:Please add the ability to permalink the graph panes. Yes! This has been in my mind for a long time, but for some reason I constantly forget or postpone doing it...
Quote:As you can see I am heavily linking and sponsoring your website everywhere both on the EvE forums and on my website, hope you like it. I like it, but it won't get you preferential support well, maybe a bit, since bad publicity is not the kind I really want :P Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
107
|
Posted - 2012.02.25 21:19:00 -
[174] - Quote
I am aware of the problems with some of the parts of the interface, however, I'm super busy in RL right now, so updates will have to be a bit delayed.
Regarding the comparisons, those can be done changed on the same page by using the plus button, and can be removed on the group summary page (click one of the links in the breadcrumbs to get there) . A link to delete on the same page will follow.
I will also mention, that though I would very much like a item summary page for combined regions, the architecture makes this a bit difficult. Would it suffice if the page would just serve the item info table and the orders list (no trends, history, manufacturing etc. At least at first?)
Good idea on splitting up the API pages, would probably make more sense and give me less headaches. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
108
|
Posted - 2012.02.28 21:10:00 -
[175] - Quote
Vaerah Vahrokha wrote:I keep having problems with the uploader (I don't delete cache files).
If I click on an item I never uploaded it works. If I click on an item I uploaded it won't work, neither in manual nor IGB mode and yes I repead the procedure you listed some posts ago.
Today I tried uploading all minerals (I did not do it since days) and it uploaded nothing at all, neither the orders nor the history.
BTW please add a category "Ice" (at least isotopes, but LO etc would be cool) so I can use the IGB for them.
Result: saving CSV extracts a file with prices of 2 days ago. My own script run over the same cache fetches all the prices, proving I indeed have the full data on my computer.
I think I now know what the problem is. The uploader only checks for filenames. Because your files are always kept, and are only overwritten (with the same name) they uploader doesn't detect changes, and therefore uploads nothing. I'll modify the check to take into account file creation date as well :)
Oh, in addition to simply creating a 'move cache instead of delete', since that will solve these kinds of problems forever. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
108
|
Posted - 2012.02.28 23:09:00 -
[176] - Quote
The EVE caching mechanism is pointless anyway, since EVE actually becomes faster when you clear the cache (the market window, anyway). At least, this was so in older versions of EVE. I haven't bothered to try out filling my cache lately.
While I agree that some items do not fit in the search box. I do not think this happens very often (to the point where you do not know what you typed into it anymore anyway). If I make the box bigger, or more the items out of it, the whole bar will be filled, and that will be very ugly (when you are logged in, you have some more options).
What I can do is expanding it on focus though, so you will be able to see all of what you type even if it disappears afterwards.
Regarding the last issue you mentioned. The value 'last updated' corresponds to is the order information. The last update for history information is not currently shown.
UPDATE:
I added some other things tonight (since I won't be able to add anything tomorrow).
1. ISK Dollar Index (found under trade information) 2. Likely sell locations for items (found on the item summary page, a new tab), that allow you to see where the items are currently sold (in the selected region) and where it could be profitable to sell them, based on asteroid belts or missioneers. 3. The comparison between regions (on the item summary page) remembers what you last selected, and now allows you to select none, if you think it is an annoying feature that just takes up screen space Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
110
|
Posted - 2012.02.29 10:17:00 -
[177] - Quote
Quote:On an unrelated matter, how the hell do you manage to code in all those cool looking and useful things so fast? Most of all, I think it's that I hack together the stuff in a framework I built myself, it isn't really the best form of architectural coding (that is, I could spend twice as much time, and end up with somewhat prettier code), but it suffices. It is easy to add things that fall within the framework, but an insane expenditure of time to fix things that fall outside of that fold (for example, combining multiple regions).
In addition, the ISK Dollar Index is just the other index pages with a different and simpler query, so that one was exceptionally easy
Quote:Also there is a SQL error at the first page of the Best LP page : Fixed it
I think the prices of blueprints are off the charts because there are no prices at all. This wasn't planned like this (wanted to show everything), I'll see if I can add them. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
111
|
Posted - 2012.03.03 17:35:00 -
[178] - Quote
Today, added a (if I may say so myself) really cool feature.
Custom item lists! You hear this correctly, you can now create lists of item types you want information about. Currently, there is not much use for that though, as there's only one page that can make use of it. Anticlimax?
That page however, is really rather cool. It is also the most complex query I've ever written for EMK. With the possible exception of the traderoute finding alghorithm (which has never been released, yet).
In any case, I had always known it was a good idea to just buy stuff in Jita, and sell it in other solar systems for a markup, because people are lazy. However, I always had problems identifying the systems where it would be a good idea to sell stuff. Partially due to now know what missioning systems were, or what agents were available, but also because checking whether there already were quite enough competitors would prove to be a days worth of work.
As it turns out, this has also proven to be a days worth of work, but now I never have to do all that again. This report will check the region for all the items you have added to the list, and give you an overview of all solarsystems in which those are sold, with some additional information to make the spotting of lucrative areas quite easy.
The easiest way to explain is to just have you try it out. Just be careful, if you enter a lot of item types, the report might take a while to run (that is, 25 is probably the max if you want it to finish anywhere in a normal span of time, if you don't mind waiting, feel free to add more items :P)
Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
111
|
Posted - 2012.03.03 20:32:00 -
[179] - Quote
****, it makes sense I should tell you that doesn't it
Account -> Lists Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
111
|
Posted - 2012.03.04 11:51:00 -
[180] - Quote
It actually doesn't take 30 seconds, because the graphing lib is so counterintuitive :P but yes, I'll see if I can do it Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
111
|
Posted - 2012.03.05 19:50:00 -
[181] - Quote
Just wanted to let you guys know I'm currently negotiating with Covert Kitty to see whether I'll buy her traderoute finding tool.
Any donations towards the 5B cost are appreciated (though not strictly necessary) . Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
113
|
Posted - 2012.03.06 17:04:00 -
[182] - Quote
Ah yes, manual groups are kind of totally broken. I'll implement the same item list system that I'm currently using for reports into the manual item selection screen before the week is done. In the meantime, you can already create item lists when you go to 'Account -> Lists'. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
113
|
Posted - 2012.03.12 20:45:00 -
[183] - Quote
I apologize for my unableness to fix manual items. And apologize more for not being able to do so in the coming time.
I have also added a poll to the EVE Marketeer homepage to gouge interest in having trade finding software (reportedly the best) bought. Usage will be free of course. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
114
|
Posted - 2012.03.13 20:19:00 -
[184] - Quote
I think you can actually edit it trough the config.ini? If you enter it there, I believe it will not automatically try to look up your installations anymore.
It should look like this:
[installations] installation_count = 1 installation_0 = C:\Users\Bart\AppData\Local\CCP\EVE\c_program_files_(x86)_ccp_eve_tranquility
That said, I'll see if I cannot make it optional, since it could potentially be annoying if issues like this exist. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
114
|
Posted - 2012.03.14 19:46:00 -
[185] - Quote
Shellac Brookdale wrote:My installations section currently looks like this:
[installations] installation_count = 0
I'll try to add a installation_0 value and see if I can get it to work.
Please do not forget to turn installation count to 1 then (I assume you were going to do this, but just to be certain )
@Scrapyard: Recorded Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
114
|
Posted - 2012.03.18 12:31:00 -
[186] - Quote
Shellac Brookdale wrote:I've added my installation path manually to config.ini and the client will start now. However, nothing happens. All upload stats will be set to zero. Browsing the market doesnt do anything in the client. Logs show nothing.
Be aware you have to add your 'eve application data' path to the config, not the installation directory of EVE itself.
In my install, this is C:\Users\Bart\AppData\Local\CCP\EVE\c_program_files_(x86)_ccp_eve_tranquility. This folder contains two other folders, called 'cache' and 'settings'.
Not exactly sure whether this would be on your computer. I believe in XP it must be C:/Documents and Settings/Bart/Application Data or something, application data is generally a hidden folder, so you might have to turn show hidden folders on to actually see it.
Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
114
|
Posted - 2012.03.18 15:05:00 -
[187] - Quote
Shellac Brookdale wrote:Found the directory and got it working now. Thanks!
Btw. how many API calls do you allow per minute/hour/day? Can you give me any number, so I can be safe you won't block my application at some point?
I just trust that if you do too many calls, everything will become very slow, and you'll stop doing as many calls. If anything truly becomes slow, I'll investigate and block someone, but that hasn't ever happened yet. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
114
|
Posted - 2012.03.20 20:28:00 -
[188] - Quote
Ah, demand is as, the total quantity of all buy orders together, at this point in time. To see the amount of items bought, you should try looking at movement, and the estimated buy/sell. This is an average per day.
As to a good indicator of what to produce, I have no idea, I'm only providing the data ^^ but there are probably a lot of people whom can tell you how to do this. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
116
|
Posted - 2012.04.01 10:24:00 -
[189] - Quote
Sorry guys, after fanfest I was (and am, probably) suffering from EVE overload, and I haven't been looking at the website for a bit, except to see whether it was running.
My ISP informed me that they were going to restart one of my servers to do some maintenance, but unfortunately informed me wrongly , and restarted the EMK server without me knowning, leading to the EMK processes stopping and not being started again for a few days. The maintenance is now complete, and the uploads are being processed again.
Should be steadily decreasing the backlog now. Last time I checked about 50000 / 2.5 hours.
UPDATE: Nothing has changed to the market scanner in the past weeks... I cannot imagine any reason for the errors except a change in the client. Which would be odd, since the other market sites are obviously working... Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
116
|
Posted - 2012.04.03 16:16:00 -
[190] - Quote
The uploading process is pretty much unaffected by big queries (at least, as far a mysql is concerned), but the server itself might be a bit slow. Regardless, this is a query you will do at most once a day, and cache the results. That is acceptable in my opinion. Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
116
|
Posted - 2012.04.07 09:49:00 -
[191] - Quote
I finally found time to do something with EMK again, so I'll be looking into this today. And see if I cannot have those processes autostart. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
117
|
Posted - 2012.04.10 14:39:00 -
[192] - Quote
Oh joy...
I'm starting to hate the server maintenance that seem to have to happen every week... It is fixed. Uploads will not be processed though, until I can restart those processes.
Regarding the uploader, it should always use the newest cache folder on startup, an completely ignore any others. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
117
|
Posted - 2012.04.14 15:09:00 -
[193] - Quote
Balls, it seems the site either crashed, or someone at my datacenter did something incredibly stupid, since my server died (presumably) without reason some 14 hours ago. I'm currently investigating this issue. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
117
|
Posted - 2012.04.14 16:45:00 -
[194] - Quote
I didn't really understand what you meant to say...
The links you provided link only to a 404 page not found.
In regards to the server being down. The sudden move of my server was cancelled, but it doesn't seem like that will bring it up again quickly, so I can only ask you to bear with it for the moment. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
118
|
Posted - 2012.04.21 20:21:00 -
[195] - Quote
LifeHatesMe wrote:Why not switch to a more reliable VPS provider like linode? Just curious.
Because Liquidweb is better, incredibly less expensive and faster. Those are just matters of opinion, but they count for a lot with me.
The whole reason people use Nginx, is that there is little reason to load PHP into memory just to serve an image. When using apache, there is little reason not to use mod_php, so...
In general, I just feel nginx is the better of the two for my purposes.
As you might have noted, the server is now up again, though it still seems to not be processing any uploads (or not saving or showing it anyway). I'm going to investigate that now.
I'm sorry for my inability to really take care of the website, but there are just more important things in my life right now. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
119
|
Posted - 2012.04.28 15:52:00 -
[196] - Quote
Yes, the server was getting timeouts, and now mysql is angry I think. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
120
|
Posted - 2012.05.06 08:48:00 -
[197] - Quote
@Scrapyard: That is what should be happening right now. It drops any items above 50, which is why the queue remains at 50. The problem is more that if it is slow enough to grow to 50, it will probably always remain there, as items are added faster than they are uploaded.
As uploads are handled in different threads, the only thing I can see having any effect on upload speed for other endpoints is the outbound bandwidth of your connection. Have you actually seen the uploader get a lot slower if one of the endpoints (AKA EVE Marketeer for the past week) is in trouble?
@Everyone: I'm sorry I am unable to fix the problems. It just grew a bit above my head, and I have little ideas on how to fix it except to do a total reset of the data involved, that might be painful, but at least the website would be working again. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
120
|
Posted - 2012.05.13 22:09:00 -
[198] - Quote
Vaerah Vahrokha wrote:Callean Drevus wrote: @Everyone: I'm sorry I am unable to fix the problems. It just grew a bit above my head, and I have little ideas on how to fix it except to do a total reset of the data involved, that might be painful, but at least the website would be working again.
Does it mean that you are going to lose all the history from 2009? It's one of the highest value your website provides. If you can't save it, could you backup prices history in some text format and make it available to download? I'll gladly go dig it by hand if the alternative is to lose all.
Price history was happily not lost, as I had just a week ago made a backup dump of all the statistical information. That was pretty good timing in hindsight.
You can reach this dump too, by going to http://www.evemarketeer.com/var/dump
I hope ot periodically update that with the new data, so it will never be suddenly lost.
On another note, the website is FUNCTIONAL again, accepting uploads, and updating. God (and you all) knows it took me long enough to fix it.
For now, I'll try to keep it operational, and free of stupid bugs, but adding new features will be on the backburner for a bit, until I get more free time again at the beginning of September. Sorry.
PS: Though I hopefully will get around to implementing UUF messages (for EMUU) and retrieving messages from EMDR. After all, EVEMon will be the most terrific datasource we ever had. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
124
|
Posted - 2012.06.03 14:26:00 -
[199] - Quote
Holy ******* hell. This was yapeal... I should've checked when I fixed the database, but the gathering of character, corporation and eve data is turned off by default when you generate the yapeal database (undoubtedly to protect us from too much data). In this case however, the only thing it was doing was preventing any useful data from being gathered at all. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
125
|
Posted - 2012.06.15 06:56:00 -
[200] - Quote
Yeah, the queue was filling up. It seems the processing threads had stopped, which I only noticed today because of another error. It seems there is a somewhat big backlog, but it will eventually all be processed now. Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
127
|
Posted - 2012.09.01 14:51:00 -
[201] - Quote
Well, change has come, and with the change, a surprising increase in motivation.
Let me explain in some more detail what happened (TEXT WALL ALERT):
About 4 months or so ago, I was happily working on my Job, and on EVE Marketeer, when I got an offer for another job, which was awesome. The catch was, that to get it, I had to work part-time for my would be new employer while I waited for my current contract to end. Needless to say, this imposed quite a lot on my spare time, as I was essentially working about 70 hours a week in total.
70 hours of work would've left some time for EVE Marketeer, but I found that after doing the programming work of two jobs, I just couldn't do anything more than just stare at a TV screen, watch a movie/series, or play a simple but addictive game like League of Legends, anything that didn't actually require me to think too much was fine.
At that point, the decision to drop EMK for the moment was made, as I had run into a few walls with the website anyway, and I couldn't really continue with expanding it without a significant rewrite. This was not the EMDR part, which was easy to add, but I just couldn't motivate myself to add it to the website when I knew I was going to totally rewrite it anyway once I returned to business. Besides, with the current processing mechanism, EMK would positively DIE the moment I turned open that valve :P
END OF TEXT WALL
Anyway, that is the long story. I'm now back to one job, which allows me to work from home even, so I should have much more opportunities to do some useful EMK work :) and hopefully supply you with (more) awesome stuff in the future again.
I'll be modifying the front post to let everyone seeing the topic know I'm back, and I'm very anxious to hear from you what exactly you used most on the current website, and what you would like to see after a rewrite. Anything goes, even things you think are impossible! Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
128
|
Posted - 2012.09.12 10:39:00 -
[202] - Quote
Happy to see you all still following :) I hope to be able to show something soon. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
130
|
Posted - 2012.10.21 12:54:00 -
[203] - Quote
Excuse me, I had a little less time than I thought I'd have, so it was taking a bit longer than I anticipated. This made me feel ashamed, since I said I'd have something by the end of September, so I felt hesitant about showing my face here until I actually had something :/
When I decided to built EMK again I wanted to do that with different technology, so that I might actually learn from it again, while preventing some of the mistakes I made previously. I originally wanted to build it in Node.JS, which was awesome, but which was so alien to me that I felt I wouldn't be able to deliver anything within a decent timespan, nor anything of the quality I really wanted. So by the end of september, I had something, but I had to scrap it because it wasn't decent enough to show anyone.
I'm now building in Python, and I have a much better feeling about it. I'm currently focusing on the backend, which will hopefully allow API calls first, then allow me to build onto that to give the website a front-end. I'm planning to use websockets for the frontend, which will hopefully make it insanely responsive compared to a traditional webapp (only it won't work in the IGB, so it' ll have to fallback to simple AJAX there). Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
130
|
Posted - 2012.10.21 20:55:00 -
[204] - Quote
Hey, thanks for that. It looks pretty good. I'll see whether anything comes of it.
It looks good, though not as good as I would've liked.
Problem with joining an already existing website is that I'll have to work together with people whom might not share my vision of what it could/should be, but it would be a great help to not be the single person responsible for keeping the website up. In addition, competition is good, but too much competition makes it very difficult to choose. Adding EMK to the mix again brings the count of market websites to a number above 5 :P Developer/Creator of EVE Marketeer
|
|
|
|